Instructional manipulation checks: Detecting satisficing to increase statistical power
نویسندگان
چکیده
0022-1031/$ see front matter 2009 Elsevier Inc. A doi:10.1016/j.jesp.2009.03.009 * Corresponding author. E-mail address: [email protected] (D.M. Op Participants are not always as diligent in reading and following instructions as experimenters would like them to be. When participants fail to follow instructions, this increases noise and decreases the validity of their data. This paper presents and validates a new tool for detecting participants who are not following instructions – the Instructional manipulation check (IMC). We demonstrate how the inclusion of an IMC can increase statistical power and reliability of a dataset. 2009 Elsevier Inc. All rights reserved.
منابع مشابه
Running head: IMC EFECTS ON NON-DIFFERENTATION AND GRICEAN NORMS 1 It’s a Trap! The Influence of Instrumental Manipulation Checks on Response Non- Differentiation and Gricean Norm Effects
The instructional manipulation check (IMC) is a methodological tool designed to measure whether participants read the instructions in a survey, and thus, it is frequently used in online studies to identify inattentive participants. However, research on survey design has suggested that participants can infer intentions from prior questions, affecting responses to later questions. As the IMC tell...
متن کاملSurvey Satisficing Inflates Stereotypical Responses in Online Experiment: The Case of Immigration Study
Though survey satisficing, grudging cognitive efforts required to provide optimal answers in the survey response process, poses a serious threat to the validity of online experiments, a detailed explanation of the mechanism has yet to be established. Focusing on attitudes toward immigrants, we examined the mechanism by which survey satisficing distorts treatment effect estimates in online exper...
متن کاملhe Impacts of Bounced Checks on Economic Growth Through the Banking Credit Risk Channel Emphasis on Enforcement of Laws: Provincial Panel Approach
This study investigates the relation between bounced checks and economic growth through the banking credit risk channel by estimation of a simultaneous equation system with panel data for 31 Iranian provinces covers the years from 2011 to 2015. For this purpose, after identifying determinants of the bounced checks, the relations of this variable with the non-performing loans, banking loans and ...
متن کاملIntegration of Interactive Interfaces with Intelligent Tutoring Systems: An Implementation Running head: Interfaces for Intelligent Tutoring Systems
Turbinia-Vyasa is an instructional system that trains operators in diagnostic problem solving in the domain of marine power plants. It is comprised of a steam power plant simulator and an intelligent tutoring system. The simulator, Turbinia, is based on a hierarchical representation of subsystems, components, and primitives together with necessary physical and logical linkages among them. Vyasa...
متن کاملCut-off models for the `go-home' decision of pedestrians in shopping streets
Many behavioral and nonbehavioral models have been proposed to model pedestrian behavior. Among these, pedestrians' decision processes have not been explicitly modeled. Utility-maximizing models have been prominently used, but these models may be misspecified owing to their unrealistic assumptions. As an alternative, this paper proposes cut-off models based on the satisficing heuristic founded ...
متن کامل